Sound spatialization across disciplines using virtual microphone control (ViMiC)

Background in Spatial Sound Perception and Synthesis. Spatial sound perception is an important process in how we experience sounds in our environment. This process is studied in the fields of otology, audiology, psychology, neuroscience and acoustical engineering. Its practical implications are notably found in communications, architectural acoustics, urban planning, film, media art and music. The synthesis of spatial sound properties by means of computer and loudspeaker technology is an ongoing research topic. Background in History of Spatial Music. In spatial music, perceptual effects of spatial sound segregation, fusion and divided attention are explored. The compositional use of these properties dates back to the 16th century and the music by Willaert and Gabrieli for spatially separated instruments and choirs. Electroacoustic inventions in the 19th and 20th century, such as microphones and loudspeakers, and the recent increase in computer resources have created new possibilities and challenges for composers. Aims. The aim of this project was to develop a perceptually convincing spatialization system that is flexible and easy to use for musical applications. Main contribution. Using an interdisciplinary approach, the Virtual Microphone Control systen (ViMiC) was developed and refined to be a flexible spatialization system based on the concept of virtual microphones. The software was tested in multiple real-world user scenarios ranging from concert performances and sound installations to movie production and applications in education and medical research. Implications. Our interdisciplinary development approach can guide other development efforts for creating user-friendly computer music tools. Due to its specific feature set, ViMiC has become a flexible tool for spatial sound rendering that can be used in a variety of scenarios and disciplines. We hope that ViMiC will motivate further creative and scientific interest in sound spatialization.